Is interactive open access publishing able to identify high‐impact submissions? A study on the predictive validity of Atmospheric Chemistry and Physics by using percentile rank classes
Identifieur interne : 000085 ( OpenAccess/Analysis ); précédent : 000084; suivant : 000086Is interactive open access publishing able to identify high‐impact submissions? A study on the predictive validity of Atmospheric Chemistry and Physics by using percentile rank classes
Auteurs : Lutz Bornmann [Allemagne] ; Hermann Schier [Allemagne] ; Werner Marx [Allemagne] ; Hans-Dieter Daniel [Suisse]Source :
- Journal of the American Society for Information Science and Technology [ 1532-2882 ] ; 2011-01.
Abstract
In a comprehensive research project, we investigated the predictive validity of selection decisions and reviewers' ratings at the open access journal Atmospheric Chemistry and Physics (ACP). ACP is a high‐impact journal publishing papers on the Earth's atmosphere and the underlying chemical and physical processes. Scientific journals have to deal with the following question concerning the predictive validity: Are in fact the “best” scientific works selected from the manuscripts submitted? In this study we examined whether selecting the “best” manuscripts means selecting papers that after publication show top citation performance as compared to other papers in this research area. First, we appraised the citation impact of later published manuscripts based on the percentile citedness rank classes of the population distribution (scaling in a specific subfield). Second, we analyzed the association between the decisions (n = 677 accepted or rejected, but published elsewhere manuscripts) or ratings (reviewers' ratings for n = 315 manuscripts), respectively, and the citation impact classes of the manuscripts. The results confirm the predictive validity of the ACP peer review system.
Url:
DOI: 10.1002/asi.21418
Affiliations:
- Allemagne, Suisse
- Bade-Wurtemberg, Bavière, Canton de Zurich, District de Haute-Bavière, District de Stuttgart
- Munich, Stuttgart, Zurich
- Université de Zurich
Links toward previous steps (curation, corpus...)
- to stream Istex, to step Corpus: 000123
- to stream Istex, to step Curation: 000123
- to stream Istex, to step Checkpoint: 000718
- to stream Main, to step Merge: 000B57
- to stream Main, to step Curation: 000B55
- to stream Main, to step Exploration: 000B55
- to stream OpenAccess, to step Extraction: 000085
Links to Exploration step
ISTEX:D9ECE9818C88B5676665107C8841C4E90F0936CELe document en format XML
<record><TEI wicri:istexFullTextTei="biblStruct"><teiHeader><fileDesc><titleStmt><title xml:lang="en">Is interactive open access publishing able to identify high‐impact submissions? A study on the predictive validity of Atmospheric Chemistry and Physics by using percentile rank classes</title><author><name sortKey="Bornmann, Lutz" sort="Bornmann, Lutz" uniqKey="Bornmann L" first="Lutz" last="Bornmann">Lutz Bornmann</name></author><author><name sortKey="Schier, Hermann" sort="Schier, Hermann" uniqKey="Schier H" first="Hermann" last="Schier">Hermann Schier</name></author><author><name sortKey="Marx, Werner" sort="Marx, Werner" uniqKey="Marx W" first="Werner" last="Marx">Werner Marx</name></author><author><name sortKey="Daniel, Hans Ieter" sort="Daniel, Hans Ieter" uniqKey="Daniel H" first="Hans-Dieter" last="Daniel">Hans-Dieter Daniel</name></author></titleStmt><publicationStmt><idno type="wicri:source">ISTEX</idno><idno type="RBID">ISTEX:D9ECE9818C88B5676665107C8841C4E90F0936CE</idno><date when="2011" year="2011">2011</date><idno type="doi">10.1002/asi.21418</idno><idno type="url">https://api.istex.fr/document/D9ECE9818C88B5676665107C8841C4E90F0936CE/fulltext/pdf</idno><idno type="wicri:Area/Istex/Corpus">000123</idno><idno type="wicri:Area/Istex/Curation">000123</idno><idno type="wicri:Area/Istex/Checkpoint">000718</idno><idno type="wicri:doubleKey">1532-2882:2011:Bornmann L:is:interactive:open</idno><idno type="wicri:Area/Main/Merge">000B57</idno><idno type="wicri:Area/Main/Curation">000B55</idno><idno type="wicri:Area/Main/Exploration">000B55</idno><idno type="wicri:Area/OpenAccess/Extraction">000085</idno></publicationStmt><sourceDesc><biblStruct><analytic><title level="a" type="main" xml:lang="en">Is interactive open access publishing able to identify high‐impact submissions? A study on the predictive validity of Atmospheric Chemistry and Physics by using percentile rank classes</title><author><name sortKey="Bornmann, Lutz" sort="Bornmann, Lutz" uniqKey="Bornmann L" first="Lutz" last="Bornmann">Lutz Bornmann</name><affiliation wicri:level="3"><country>Allemagne</country><placeName><settlement type="city">Munich</settlement><region type="land" nuts="1">Bavière</region><region type="district" nuts="2">District de Haute-Bavière</region></placeName><wicri:orgArea>Max Planck Society, Office of Research Analysis and Foresight, Hofgartenstr. 8</wicri:orgArea></affiliation><affiliation wicri:level="1"><country wicri:rule="url">Allemagne</country></affiliation></author><author><name sortKey="Schier, Hermann" sort="Schier, Hermann" uniqKey="Schier H" first="Hermann" last="Schier">Hermann Schier</name><affiliation wicri:level="3"><country xml:lang="fr">Allemagne</country><wicri:regionArea>Max Planck Institute for Solid State Research, Heisenbergstraße 1, D‐70569 Stuttgart</wicri:regionArea><placeName><region type="land" nuts="1">Bade-Wurtemberg</region><region type="district" nuts="2">District de Stuttgart</region><settlement type="city">Stuttgart</settlement></placeName></affiliation><affiliation wicri:level="1"><country wicri:rule="url">Allemagne</country></affiliation></author><author><name sortKey="Marx, Werner" sort="Marx, Werner" uniqKey="Marx W" first="Werner" last="Marx">Werner Marx</name><affiliation wicri:level="3"><country xml:lang="fr">Allemagne</country><wicri:regionArea>Max Planck Institute for Solid State Research, Heisenbergstraße 1, D‐70569 Stuttgart</wicri:regionArea><placeName><region type="land" nuts="1">Bade-Wurtemberg</region><region type="district" nuts="2">District de Stuttgart</region><settlement type="city">Stuttgart</settlement></placeName></affiliation><affiliation wicri:level="1"><country wicri:rule="url">Allemagne</country></affiliation></author><author><name sortKey="Daniel, Hans Ieter" sort="Daniel, Hans Ieter" uniqKey="Daniel H" first="Hans-Dieter" last="Daniel">Hans-Dieter Daniel</name><affiliation wicri:level="4"><country xml:lang="fr">Suisse</country><wicri:regionArea>ETH Zurich, Professorship for Social Psychology and Research on Higher Education, Zähringerstr. 24, CH‐8092 Zurich; University of Zurich, Evaluation Office, Mühlegasse 21, CH‐8001 Zurich</wicri:regionArea><orgName type="university">Université de Zurich</orgName><placeName><settlement type="city">Zurich</settlement><region nuts="3" type="region">Canton de Zurich</region></placeName></affiliation><affiliation wicri:level="1"><country wicri:rule="url">Suisse</country></affiliation></author></analytic><monogr></monogr><series><title level="j">Journal of the American Society for Information Science and Technology</title><title level="j" type="abbrev">J. Am. Soc. Inf. Sci.</title><idno type="ISSN">1532-2882</idno><idno type="eISSN">1532-2890</idno><imprint><publisher>Wiley Subscription Services, Inc., A Wiley Company</publisher><pubPlace>Hoboken</pubPlace><date type="published" when="2011-01">2011-01</date><biblScope unit="volume">62</biblScope><biblScope unit="issue">1</biblScope><biblScope unit="page" from="61">61</biblScope><biblScope unit="page" to="71">71</biblScope></imprint><idno type="ISSN">1532-2882</idno></series><idno type="istex">D9ECE9818C88B5676665107C8841C4E90F0936CE</idno><idno type="DOI">10.1002/asi.21418</idno><idno type="ArticleID">ASI21418</idno></biblStruct></sourceDesc><seriesStmt><idno type="ISSN">1532-2882</idno></seriesStmt></fileDesc><profileDesc><textClass></textClass><langUsage><language ident="en">en</language></langUsage></profileDesc></teiHeader><front><div type="abstract" xml:lang="en">In a comprehensive research project, we investigated the predictive validity of selection decisions and reviewers' ratings at the open access journal Atmospheric Chemistry and Physics (ACP). ACP is a high‐impact journal publishing papers on the Earth's atmosphere and the underlying chemical and physical processes. Scientific journals have to deal with the following question concerning the predictive validity: Are in fact the “best” scientific works selected from the manuscripts submitted? In this study we examined whether selecting the “best” manuscripts means selecting papers that after publication show top citation performance as compared to other papers in this research area. First, we appraised the citation impact of later published manuscripts based on the percentile citedness rank classes of the population distribution (scaling in a specific subfield). Second, we analyzed the association between the decisions (n = 677 accepted or rejected, but published elsewhere manuscripts) or ratings (reviewers' ratings for n = 315 manuscripts), respectively, and the citation impact classes of the manuscripts. The results confirm the predictive validity of the ACP peer review system.</div></front></TEI><affiliations><list><country><li>Allemagne</li><li>Suisse</li></country><region><li>Bade-Wurtemberg</li><li>Bavière</li><li>Canton de Zurich</li><li>District de Haute-Bavière</li><li>District de Stuttgart</li></region><settlement><li>Munich</li><li>Stuttgart</li><li>Zurich</li></settlement><orgName><li>Université de Zurich</li></orgName></list><tree><country name="Allemagne"><region name="Bavière"><name sortKey="Bornmann, Lutz" sort="Bornmann, Lutz" uniqKey="Bornmann L" first="Lutz" last="Bornmann">Lutz Bornmann</name></region><name sortKey="Bornmann, Lutz" sort="Bornmann, Lutz" uniqKey="Bornmann L" first="Lutz" last="Bornmann">Lutz Bornmann</name><name sortKey="Marx, Werner" sort="Marx, Werner" uniqKey="Marx W" first="Werner" last="Marx">Werner Marx</name><name sortKey="Marx, Werner" sort="Marx, Werner" uniqKey="Marx W" first="Werner" last="Marx">Werner Marx</name><name sortKey="Schier, Hermann" sort="Schier, Hermann" uniqKey="Schier H" first="Hermann" last="Schier">Hermann Schier</name><name sortKey="Schier, Hermann" sort="Schier, Hermann" uniqKey="Schier H" first="Hermann" last="Schier">Hermann Schier</name></country><country name="Suisse"><region name="Canton de Zurich"><name sortKey="Daniel, Hans Ieter" sort="Daniel, Hans Ieter" uniqKey="Daniel H" first="Hans-Dieter" last="Daniel">Hans-Dieter Daniel</name></region><name sortKey="Daniel, Hans Ieter" sort="Daniel, Hans Ieter" uniqKey="Daniel H" first="Hans-Dieter" last="Daniel">Hans-Dieter Daniel</name></country></tree></affiliations></record>Pour manipuler ce document sous Unix (Dilib)
EXPLOR_STEP=$WICRI_ROOT/Wicri/Belgique/explor/OpenAccessBelV2/Data/OpenAccess/Analysis
HfdSelect -h $EXPLOR_STEP/biblio.hfd -nk 000085 | SxmlIndent | more
Ou
HfdSelect -h $EXPLOR_AREA/Data/OpenAccess/Analysis/biblio.hfd -nk 000085 | SxmlIndent | more
Pour mettre un lien sur cette page dans le réseau Wicri
{{Explor lien
|wiki= Wicri/Belgique
|area= OpenAccessBelV2
|flux= OpenAccess
|étape= Analysis
|type= RBID
|clé= ISTEX:D9ECE9818C88B5676665107C8841C4E90F0936CE
|texte= Is interactive open access publishing able to identify high‐impact submissions? A study on the predictive validity of Atmospheric Chemistry and Physics by using percentile rank classes
}}
| This area was generated with Dilib version V0.6.25. |  |